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METHOD AND SYSTEM FOR AUTOMATED MONITORING OF QUALITY OF 
SERVICE OF DIGITAL VIDEO MATERIAL DISTRIBUTION AND PLAY-OUT 

FIELD OF THE INVENTION 

The present invention relates to a method for measuring the quality of service and the 
duration of a given digital video program that has been transmitted, including in the 
compressed domain (e.g., MPEG-2 PES level). 

BACKGROUND OF THE INVENTION 

When distributing video material over cable channels, satellite, or air waves, it is 
necessary to measure the quality of service of the distribution system. Quality of service of 
distribution is measured according to whether the video material was delivered in whole and 
on time and to the proper location/audience. For example, advertisers that play video material 
over television or cable channels need to verify that their shows, commercials or spots actually 
play to air. Companies also need to monitor and track video (digital or analog) files as well as 
perform certain tasks based on the usage of the video file (e.g., billing royalties based on video 
use). Today, there are a few methods to perform this validation. 

In current distribution environments, i.e., analog environments, monitoring distribution 
of video material, whether compressed (digital) or uncompressed (analog), for quality of 
service relies on techniques that utilize significant manual human activities. These methods 
include: 

1 . Taping the day's programs and then having a person review the tape to see that 
the material played. 
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2. Using industry groups (e.g., Neilsen) that have employees literally watch TV to 
see that the material plays. These people enter the information on paper. This information is 
then consolidated and reports are sent back to the advertisers. 

3. Using video detectors that can detect loss of signal, but can't typically tell if the 

video is playing correctly or not. 

4. Tracking the location and path that files are distributed. 

These approaches are not very reliable and are time consuming. Furthermore, these 
approaches require a long time between validation and correlation at the program source/ad 
agency. 

Accordingly, a need exists for a more efficient and automated manner of verifying the 
quality of service of video material being distributed and played, particularly in the compressed 
domain. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

The present invention provides method and system aspects for automated monitoring of 
quality of service of digital video material being distributed and played. The aspects include 
embedding a signature in each frame of the digital video material by a program source device 
control. Computation of play-out statistics for the digital video material based on the signature by 
a program play-out device control is also included. 

Through the present invention, determining statistics on a particular video program 
occurs in a manner that avoids intensive manual human monitoring and provides a more 
efficient and automatic ability to achieve quality of service measurements. The present 
invention utilizes technology to embed hidden data into a video or associate data with the 
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video file, and provides the ability to take correlated hidden data and video images together 
that an application can then process to do applications such as billing, quality of service 
measurements, rights management, and external device control These and other advantages of 
the aspects of the present invention will be more fully understood in conjunction with 
5 following detailed description and accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a block diagram of a digital video distribution system in accordance 
; H with the present invention. 

Hf Figure 2 illustrates a block flow diagram of automated quality of service monitoring in 

the system of Fig. 1 in accordance with the present invention. 

m DETAILED DESCRIPTION 

W The present invention relates to method and system aspects for automated monitoring 

H of the quality of service of digital video material distribution and play-out. The following 

description is presented to enable one of ordinary skill in the art to make and use the invention 
and is provided in the context of a patent application and its requirements. Various 
modifications to the preferred embodiment and the generic principles and features described 
herein will be readily apparent to those skilled in the art. Thus, the present invention is not 
20 intended to be limited to the embodiment shown but is to be accorded the widest scope 

consistent with the principles and features described herein. 

Figures 1 and 2 present a block system diagram and a block flow diagram, respectively, 
of a preferred embodiment of the present invention for automated monitoring of quality of 
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service of digital video material distribution and play-out. Digital video material is provided 
from a video program source 10 for inclusion with a program feed, e.g., a satellite program 
feed, a cable feed, or a terrestrial feed. The digital video source material is encoded (e.g., at a 
central location associated with the program source 10) with hidden data (step 100). 
Preferably, the hidden data includes a signature computed by a chosen hashing function, e.g., 
CRC for each frame belonging tg the digital program material By way of example, a digital 
advertisement or Ad, that lasts 30 seconds and is played at 30 fps (frames per second) contains 
900 frames; for each frame, an individual signature is computed, thus resulting in 900 
signatures for the Ad. Preferably, a header of the signature includes a key identifier that will 
enable detection of the presence of the signature in the frame, as is well appreciated by those 
skilled in the art. Further, the hashing function used to compute the signature preferably 
provides a very small probability of a false match (<0.01%). 

Encoding of the digital video source material also includes creation of a meta-stream 
for the material. The meta-stream includes a header session, (e.g., Ad Identifier, Ad length, 
and other relevant information), that is multiplexed into the meta-stream by the source device 
10 and transmitted using an appropriate encryption algorithm to avoid tampering of the meta- 
stream contents, i.e., to avoid a maliciously generated meta-stream that yields non valid results. 
Additionally, the header session includes a play-out schedule for the digital video material, 
(e.g., the Ad Identifier and a time that the Ad is scheduled to play). 

A play-out device 20 receives the incoming program data with the encoded digital 
video source material for play-out to a display device 30, e.g., a television. Examples of 
suitable play-out devices 20 include a cable system, a set-top box, and a computer. The play- 
out device 20 demultiplexes the incoming program data by well known techniques and 
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captures the meta-stream in order to initiate computation of the signature for the incoming 

digital video data (step 1 10). 

Because of the high bit rate requirements for the distribution of high quality 
video/audio, a compression scheme can be used to significantly reduce the bandwidth 
5 requirements (e.g. MPEG-2 can achieve 1:100 compression ratio). Additionally the usage of 

high efficient modulation schemes (e.g., QAM, QPSK, VSB) allows for several compressed 
video streams to be multiplexed over the same analog channel. In the MPEG-2 standard, a 
built-in multiplexing scheme (Transport Stream) provides the facilities for such multiplexing, 

I where each video stream is packetized (into 1 88 byte packets) and a range of PID (packet 

II identifiers) are assigned for each program, as is well understood by those skilled in the art. 
S The preferred embodiment uses a MPEG-2 demultiplexer that is capable of receiving 
m (de-multiplexing) all the individual programs that are multiplexed over the MPEG-2 Transport 
1 Stream. A real time parser removes the transport layer (Packet header, adaptation field, etc.), 
y extracting the video PES layer. 

5 A signature engine in the video play-out device 20 parses the video PES layer 

(removing PES headers) and computes signatures utilizing the video payload, so that for each 
frame (I, B, and P) a signature is computed. Appropriately, the hashing function used to 
compute the signature at the play-out device 20 is the same as the one used in the source device 
10. Once the signature is computed, it is stored in a local storage associated for each individual 

20 program. 

The meta-stream is then utilized to determine statistics related to the play-out of the 
digital video data (step 120). When the video data is received by the play-out device, the 
hidden data is detected on a minimum of a frame basis. By detecting the hidden data, the 
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number of frames there were correctly decoded is computed, and therefore, with a very high 
probability, the video data is considered to have played-out correctly (i.e., been a visible 
image). Further, with the detection of the hidden data at the start and end of the video data, 
validation that the entire video data actually played-out results. By way of example, the Ads 

5 scheduler information is utilized to trigger a matching engine, i.e., to trigger the start of a 

comparison between the incoming signatures of the digital video in the hidden data with the 
ones stored. Thus, computation of the statistics includes computing a number of frames that 
have the correct signature, the time the video material was effectively played, the video 

% material duration, etc. The statistics determined are preferably stored on a non- volatile local 

l§h storage of the play-out device 20. The play-out play-out statistics can then be automatically 

fU analyzed through desired application programming for quality of service measurements (step 

m 130). Preferably, the statistics collected are transmitted back to the program source 10 using an 

encryption scheme in keeping with the one used by the program source 1 0 for analysis. 

y Through the present invention, determining statistics on a particular video program 

1 S3 occurs in a manner that avoids intensive manual human monitoring and provides a more 

efficient and automatic ability to achieve quality of service measurements. The present 
invention utilizes technology to embed hidden data into a video or associate data with the 
video file, and provides the ability to take correlated hidden data and video images together 
that an application can then process to do applications such as billing, quality of service 
20 measurements, rights management, and external device control. The hidden data can be put 

into the video image side bands, user data or other location that is transparent to the video 
image. 
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Although the present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will readily recognize that there could be 
variations to the embodiments and those variations would be within the spirit and scope of the 
present invention. Accordingly, many modifications may be made by one or ordinary skill in 
the art without departing from the spirit and scope of the appended claims. 
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CLAIMS 



What is claimed is: 



1 LA method for automated monitoring of quality of service of digital video material 

2 being distributed and played, the method comprising: 

3 embedding a signature breach frame of the digital video material by a program source 

4 device control; and 

5 computing play-out statistics for the digital video material based on the signature by a 
program play-out device control 

\| 2. The method of claim 1 wherein the step of embedding further comprises utilizing a 

s 2 hashing algorithm to produce the signature for each frame in the digital video material during 

"3 encoding of the digital video material. 

~1 3. The method of claim 2 further comprising providing a key identifier in a header of the 

2 signature and identifying inclusion of the signature based on the key identifier. 

1 4. The method of claim 2 wherein embedding further comprises creating a meta-stream 

2 for the digital video material and encrypting the meta-stream. 

1 5. The method of claim 4 wherein the meta-stream further comprises a header session. 
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6. The method of claim 5 wherein the header session further comprises an identifier, a 
length, and a time of play-out of the digital video material. 

7. The method of claim 4 wherein the step of computing statistics further comprises 
capturing the meta-stream and computing the signature for an incoming stream of digital video 
material. 

8. The method of claim 7 further comprising utilizing the signature of the meta-stream to 
trigger comparison with the computed signature of the incoming stream of digital video material. 

9. The method of claim 8 further comprising computing a number of frames having a 
matching signature to the computed signature, identifying a time of play-out for the video stream, 
and determining a duration of the digital video material played-out. 

1 0. The method of claim 9 further comprising storing the play-out statistics on a local 
storage device for the play-out device control. 

1 1 . The method of claim 1 0 further comprising transmitting the play-out statistics back 
for the program source device control for quality of service measurements. 

12. The method of claim 1 wherein the digital video material further comprises a digital 
advertisement. 
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13. A system for automated monitoring of quality of service of digital video material 
being distributed and played, the system comprising: 

a program source of viewing program data, the program source embedding a signature in 
each frame of digital video material within the viewing program data; 

a play-out device for receiving the viewing program data and computing play-out 
statistics for the digital video material based on the signature; and 

a display device coupled to the play-out device for displaying video output of the viewing 
program data from the play-out device. 

14. The system of claim 13 wherein the viewing program data further comprises a cable 
station program feed. 

15. The system of claim 13 wherein the viewing program data further comprises a 
satellite program feed. 

16. The system of claim 13 wherein the viewing program data further comprises an air 
wave program feed. 

17. The system of claim 13 wherein the play-out device further comprises a set-top cable 

box. 

1 8. The system of claim 13 wherein the play-out device further comprises a cable head- 
end. 
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19. The system of claim 13 wherein the play-out device further comprises a computer. 

20. The system of claim 13 wherein the digital video material further comprises a digital 
advertisement. 

21 . The system of claim 13 wherein the program source further provides the signature in 
a meta-stream, the meta-stream including an identifier for the digital video material, a length of 
the digital video material, and a time for play-out of the digital video material. 

22. The system of claim 21 wherein the play-out device further computes play-out 
statistics by capturing the meta-stream, computing a signature for the digital video material, and 
comparing the computed signature to the provided signature. 

23. The system of claim 22 wherein the video play-out device further computes statistics 
by computing a number of frames in the digital video material having a match condition with the 
signature, identifying a time of play-out of the digital video material, and determining a duration 
of the digital video material actually played-out. 

24. The system of claim 23 wherein the video play-out device stores the play-out 
statistics in a local storage and transmits the play-out statistics to the program source, wherein the 
program source measures quality of service for the digital video material from automated analysis 
of the play-out statistics. 
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25. A method for achieving automated monitoring of quality of service of digital 
video material play-out in a video distribution and display system, the method comprising: 

embedding video source material at a program source with hidden data and a meta-stream 
for uniquely marking a digital advertisement with the video source material; 

isolating the meta-streamand the digital advertisement from the video source material in 
a program play-out device; and 

utilizing the meta-stream in the program play-out device to determine play-out statistics 
for the digital advertisement. 

26. The method of claim 25 wherein the hidden data further comprises a signature 
generated by a hashing algorithm for each frame of the digital advertisement. 

27. The method of claim 25 wherein the meta-stream further includes an identifier for the 
digital advertisement, a number of frames of the digital advertisement, and a time for play-out of 
the digital advertisement 

28. The method of claim 27 wherein the play-out statistics further comprise a start-time 
of play-out, a number of frames in the digital advertisement correctly decoded, and an end-time of 
play-out of the digital advertisement. 
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29. The method of claim 28 further comprising providing the play-out statistics to the 
program source, and analyzing the play-out statistics to determine quality of digital advertisement 
display. 
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ABSTRACT 

Method and system aspects for automated monitoring of quality of service of digital 
video material being distributed and played are described. The aspects include embedding a 
signature in each frame of the digital video material by a program source device control. 
Computation of play-out statistics for the digital video material based on the signature by a 
program play-out device control is also included. 
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